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A  possible  method  for  compensating  for  uncertainty  in  linear -programming 
problems  is  to  replace  the  random  elements  by  expected  values  or  by 
pessimistic  estimates  of  these  values,  or  to  recast  the  problem  into 
a  two-stage  program  so  that,  in  the  second  stage,  one  can  compensate 
for  "inaccuracies"  in  the  first  stage.  The  purpose  of  RM-2751  is  to 
examine  the  last  of  these  methods  in  detail.  More  precisely,  it 
investigates  the  conditions  under  which  the  first-stage  decisions 
are  optimal.  In  addition,  formulas  for  using  various  existing  compu¬ 
tational  algorithms  to  obtain  an  optimal  solution  are  given. 
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SUMMARY 

In  this  paper,  we  study  the  linear  programming  problem 

Ax  +  By  *  b, 
x  ;>  0,  y  >  0, 

i  i 

c  x  +  E  min  f  y  -  min, 

y 

where  b  is  a  random  vector.  Many  3hort-range  inventory  problems 
can  be  expressed  mathematically  as  such  a  program.  Conditions 
are  given  for  optimality  of  x  based  on  the  optimal  dual  vectors 
7r(b,  x)  of  the  program 

By  »  b  -  Ax, 

y  ^  o» 

! 

f  y  ■  min. 

In  case  b  has  a  finite  discrete  distribution,  an  explicit  re¬ 
lationship  between  the  optimal  dual  vectors  for  the  two  problems 
is  obtained.  Finally,  formulas  for  using  various  existing 
computational  algorithms,  when  appropriate,  for  obtaining  an 
optimal  x  are  given. 
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ON  THE  SOLUTION  OF  TWO— STAGE 
LINEAR  PROGRAMS  UNDER  UNCERTAINTY 

1 ■  INTRODUCTION 

In  this  paper,1  we  shall  study  the  program  with  constraints 
given  by 

^  Ax  +  By  »  b, 

.  *  1  0,  y  >  0, 

where  A  and  B  are  known  m  x  n1  and  m  x  n?  matrices,  x  and  y 
are  and  ^-dimensional  vectors,  and  b  is  a  random  m-dimension- 

al  vector  with  known  distribution.  We  wish  to  minimize,  with 
respect  to  x,  the  expression 

(2)  E  min  (c 'x  +  f 'y), 

y 

where  c  and  f  are  known  n j-  and  ^-dimensional  vectors,  E  denotes 
expectation  with  respect  to  the  distribution  of  b,and  0*  denotes 
the  transpose  of  0. 

As  an  example  of  a  situation  leading  to  such  a  program, 
consider  the  set  of  possible  polyhedra  given  by  Ax  o  b,  x  >  0, 
where  b  is  random  and,  in  contrast  to  the  usual  case  [6]  in 
which  one  minimizes  c  x  subject  to  x  lying  in  the  intersection, 
over  b,  of  these  polyhedra,  one  is  instead  allowed,  after 
selecting  an  x  and  subsequently  observing  b,  to  compensate  with 

1The  authors  wish  to  acknowledge  the  valuable  comments 
and  suggestions  of  their  colleagues  D.  R.  Fulkerson  and  Philip 
Wolfe.  1 
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a  vector  y  ^  0  for  infeasibility  of  the  selected  x,  at  a 
penalty  cost  f  y,  where  f  £  o.  In  this  case  By  would  be 

y+  ~  y~  and  th'!  vector  y  that  yields  the  smallest  penalty  coat 
for  each  b  and  x  would  be  composed  of  two  parts, 

y  »  b  -  Ax,  y  ®  0  if  b  £  Ax  or  y“  »  Ax  -  b,  y+  -  o  if  b  <  Ax. 

Sinoe  the  choice  of  y  depends  on  b  as  well  as  x,  we  alter  the 
objective  from  minimizing  o'x  to  minimizing  c 'x  plus  the  ex¬ 
pected  smallest  penalty  cost. 

Many  short-range  inventory  problems  can  be  expressed  mathe 
matically  as  such  a  program.  The  vector  x  may  represent  an 
inventory  that  is  to  be  bought  at  cost  o'x  before  the  random 
demand  b  is  observed.  Once  b  is  observed,  one  must  compensate 
by  a  vector  y  (at  cost  f *y)  for  imbalances  (b  -  Ax)  between  the 
original  inventory  and  the  demand  so  as  to  satisfy  (l).  For 
example,  coordinates  of  this  vector  y  may  represent  the  amount 
of  additional  inventory  to  be  bought  immediately  to  meet  the 
excess  of  demand  over  supply  or  the  amount  of  inventory  to 
discard  in  case  of  an  excess  of  inventory  over  demand. 

As  the  structure  of  the  problem  involves  a  decision  x  to 
be  made  first,  after  which  the  random  vector  b  is  observed  and 
a  second  decision  y  is  made,  we  term  this  a  two-Btage  problem. 
It  may  be  that  some  coordinates  of  b  are  not  random  and  that 
the  corresponding  equations  do  not  involve  y.  we  shall  call 
these  equations  "fixed  constraints"  on  x. 

The  structure  of  the  matrices  A  and  B  may  impose  further 
constraints  on  x.  For  example,  B  may  be  a  positive  matrix,  in 
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which  ease  Ax  +  By  •  b  end  y  ^  0  Imply  that  Ax  <  b.  We  shall 
call  such  constraints  "induced  constraints."  These  constraints 
of  course  may  depend  on  the  value  of  the  random  vector  b. 

If  some  equations  do  not  Involve  y  but  the  corresponding 
subvector  of  b  la  random,  we  wish  to  restrict  our  attention  to 
the  modified  problem  in  which  we  take  as  a  fixed  constraint  on 
x  the  provision  that  x  satisfies  some  apeoifio  one  of  all  these 
equations.  We  further  assume  that,  for  each  x^o  and  satisfying 
all  existing  fixed  and  all  possible  induced  constraints,  and 
for  each  b,  there  exists  a  y  such  that  (x,  y)  is  feasible,  i.e., 
satisfies  (1). 

This  last  assumption  may  seem  very  restrictive,  as  it  Bays 
that,  given  any  feasible  x  and  possible  b,  the  set  of  linear 
equations  By  -  b  —  Ax  must  have  a  nonnegative  solution.  This 
assumption  is  motivated  by  the  desire  to  solve  a  claaa  of  pro¬ 
blems  that  can  be  expressed  aa  the  program  given  In  (1)  and  for 
which  this  assumption  is  necessary  for  the  problem  to  have  a 
solution.  The  constraints  of  this  class  of  problems  have  the 
structure 

Allx  01 

(5)  A21x  +  A22y  »  bg, 

x  >  0,  y  ^  0, 

where  b^  ia  a  known  vector  and  bg  is  a  random  vector  with  known 
distribution,  it  is  clear  that  these  constraints  can  be  written 
as  those  of  the  program  in  (1)  and  that  in  this  format,  if  the 
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objective  function  for  (?)  la  of  the  form  of  (2),  we  have  a 
two— sta .pjo  program  with  fixed  constraints  on  x.  A  further  de¬ 
scription  of  the  underlying  problem  giving  rise  to  the  structure 
in  (3)  and  an  example  of  such  a  problem  are  presented  In  (2]. 

As  an  alternative  to  this  assumption,  we  can  define  K  aa 
the  convex  set  of  x  such  that  eaoh  x  c  K  Is  nonnegafcive  and  haa 
an  associated  y  for  eaoh  b  Buoh  that  (x,  y)  Is  feasible.  The 

problem  ia,  then,  to  find  x  e  K  minimizing  c'x  +  E  min  f  y. 

y 

These  x  certainly  satisfy  all  fixed  and  induced  constraints. 

2.  OPTIMALITY  C0NDITI0W3 

Let  ua  first  study  the  program. 

By  -  b  -  Ax, 

(*)  y  ;>  0, 

f  y  »  min, 

and  its  dual  for  each  b  and  x»  We  assume  the  existence  of  a  t 
that  is  feasible  for  the  dual  of  the  program  given  by  (4)  for 
each  b  and  x.  By  the  existence  theorem  for  linear  programming, 
this  assumption  plus  the  feasibility  property  of  the  convex 
set  K  for  the  program  given  by  (l)  and  (2)  guarantees  the 
existence  of  at  least  one  optimal  dual  veotor  tr  =*  m  (b,  x) 
maximising  v' (b  —  Ax)  subject  to  i^B  <  f ' . 

By  the  duality  theorem, 

(5)  min  f'y  »•  Tr'(b,  x)(b  -  Ax), 

y 


ao  that 
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(6)  min  o  x  +  f  y  «  o  x  +  t  (b,  x)(b  -  Ax)  -  c(b,  x), 

y 

say,  and 

(7)  EC(b#  x)  -  c  #x  +  Em'tb,  x)(b  -  Ax).1 

The  optimal  x  is  then  the  x  that  minimizes  EC(b,  x)  subject  to 
X  €  K. 

The  following  theorem  establishes  an  immediate  necessary 
oondition  for  some  vector  x  •  x  to  be  optimal. 


Theorem  1.  Let  x  be  optimal  and  let  m(b,  x1)  be  anjr  vector 
that  optimizes  the  dual  of  (4)  for  given  b  and  x  «»  x^,  where 
X1  •  K*  Then 

to  -  E?'(b,  Xj  )A  ]  x  <  [c  '  -  Ett '  ( b ,  x1)A]x1. 

Proof.  Since  x  is  optimal  and  x1  is  feasible,  we  have 

(8)  o  x  +  Er  (b  ,  x)(b  -  Ax)  <  c’xj  +  Ev'(b,  X]L)(b  -  Ax^, 

Also,  since  m'(b,  x)  optimizes  the  dual  of  (4)  when  x  »  x,  we 
have 

(9)  Ei’fb,  x)(b  -  Ax)  ^  E?’(b,  X;L)(b  -  Ax). 

Hence 


(10) 


e’x  +  ’Eir'  (b,  x^b  -  Ax)  ^  c'X]L  +  Er'(b,  x^b  -  aX]l). 


shall  Snn  h ^-?kS;L b  and  ?  there  are  many  optimal  w’9,  we 

vector  chosen  from  these  optima,  unless 
some  explicit  statement  to  the  contrary  is  made. 
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The  following  lemmas  enable  us  to  obtain  another  necessary 
oondition  for  some  veotor  x  *  x  to  be  optimal. 

E(3(b,  x)  is  a  convex  function  of  x. 

Proof.  Ifc  is  easy  to  check  directly  from  the  definition 
of  oonvexity  that  C(b,  x)  is  convex  in  x  for  each  b  ([l]). 

Then  EC(b,  x)  is  a  convex  function  of  x. 

2.  The  £ lane  e  -  (c*  -  E“'(b,  x^Ajx  +  Ei'(b, 
ii  «  support  plane  to  EC(b,  x)  at  x  -  xj. 

Proof.  Since  at  x  «=  Xj  this  plane  intersects  EC(b,  x), 
all  we  need  show  is  that,  for  x  «f>  xJf 

01)  to'  -  E?'(b,  Xl)A)  *  +  Esr'(b.  Xl)b  £  tc’  -  E?'(b,  x)A]  * 

+  Ett  (b,  x)b. 

But  this  is  true  if  and  only  if 

(b>  xj)(h  ~  Ax)  <  E?'(b,  x)(b  -  Ax), 

and  this  is  so,  since  Tr(b,  x)  is  optimal  for  the  dual  of  (4). 

A  consequence  of  these  lemmas  is  the  following  theorem. 

2.  Let_  x  be  a  relative  Interior  point  of  K  and 
let  EC(b,  x)  be  differentiable  in  the  neighborhood  of  x.  Then 

exists  a  i(b,  x)  such  that  c'  -  E?'(b,  x)a  -  0  if  and  only 
i£  x  is,  optimal.- 
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Proof,  Since  the  convex  function  EC(b,  x)  ie  differ¬ 
entiable  at  x,  the  supporting  hyperplane 

8  -  [c*  -  Ev'(b,  x)A J  x  +  Ev'tb,  x)b 
ia  tangent  to  EC(b,  x)  at  x  -  x.  Henoe 


ia  a  neeeseary  condition  for  x  to  be  optimal.  Sinoe  x  is  a 
relative  Interior  point  of  K,  the  oondition  is  also  sufficient. 

Returning  once  again  to  the  program  given  in  (4),  let 
y^b,  x)  denote  the  solution  of  this  program  for  given  bf  x. 

Then  i(b,  x)  end  y(b,  x)  are  saddle  points  of  the  function 

(15)  f(y,  t|x)  •  f 'y  +  T*(b  -  ax  -  By). 

Let  4(x,  y,  tt)  -  o  x  +  E^(y,  v|x).  We  then  have  the  following 
results. 


Theorem  Let  x  be  optimal  for  the  two— stage  problem 
arid  y(b,  x),  v(b,  x)  be  optimal  for  (4)  and  its  dual.  Then 

(IS)  $(Xj  y,  tt)  £  0(x,  y,  ?)  £  t(x,  y,  ?). 

Convaraely:t  if  there  exist  vectors  x  e  K  and  ?  feasible  for 
2*  (*0  that  satisfy  (16),  then  x  is  optimal  for  the 

problem  and  tt  is  optimal  for  the  dual  of  ( 4 )  when 


X  M  X. 
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freof*  Since  t>(y,  irjx)  <  ^{7,  7|x),  we  have 
•  •• 

•  '  T}  ^x‘  y'  m)  «  o  x  +  E^(y,  v|x)  <  c'x  +  E^(y,  7|x)  -  $(x,  y,  t). 
Now  write  $(x,  y,  ir)  as 

US)  $(x,  y,  ?)  -  o  x  +  Ei’(b,  x)(b  -  Ax)  +  Eff  *  -  v'fb,  x)B}y(b,  x). 

Since  ir(b,  x)  is  optimal  for  the  dual  of  (4),  by  the  duality 
theorem  the  function  f  -  v  (b,  x)B  haa  the  property  that  Its 
1-th  coordinate  la  zero  If  the  i~th  coordinate  of  y(b,  x)  Is 
positive.  This  and  the  nonnegativity  of  y(b,  x)  Imply  that 

(19)  $(x,  y.  ir)  -  c  x  +  Ev'(b#  x)(b  -  Ax)  -  EC(b,  x) 

and,  by  optimality  of  x, 

(2o>  *(*>  7*  v)  <  $(*,  y,  i). 

To  prove  the  converse,  wa  must  first  show  that  ?(b,  x)  le 
optimal  for  the  dual  of  (4).  Then,  since  *(x,  y,  ~)  .  EC(b,  x), 

it  la  immediately  clear  that  x  13  optimal  for  the  two-stage 
stochastic  program. 

Let  ir  (b,  x)  be  optimal  for  the  dual  of  (4).  Then 

(21)  Eir*'(b,  x)(b  ~  Ax)  >  Ev'(b,  x)(b  -  Ax), 

and  also 

U2)  l*  —  V  (b,  x)B)  y(b,  x)  *  0. 
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But  ?(b,  x)  satisfies  *(x,  y,  r)  <  *(*,  y,  J),  or 

(23)  Ett  (b,  5c)  (b  -  ax)  <  Ew'fb,  x)(b  -  Ax) 

+  Eff’  -  5r*(b,  x)b]  y(b,  x). 

f  18  nofc  optimal,  then  [f '  -  ir*<b,  x)B)  y(b,  5c)  >  o, 

and  hence  (23)  contradicts  (21). 

*his  theorem  is  the  analogue.  In  the  two-stage  problem 
dealt  with  here,  of  the  duality  theorem  for  the  one-stage  linear 
team  decision  problem  under  uncertainty  given  in  [6J.  By  means 

of  this  theorem,  we  can  prove  in  general  the  following  sufficient 
condition  for  optimality  of  x  -  x. 

?h-e-reiw  *(b»  *)  be  optimal  for  the  dual  of  (4) 

when  x-  3c.  If  [c '  -  Bi'(b,  x)A]  x  <  [o’  -  E?*(b.  Sc)A]x  for 
all  x  c  K,  then  5c  is  optimal  for  the  two-stage  problem. 

Proof.  Optimality  of  v(b,  x)  for  the  dual  of  (4)  when 
x  ^  3c  immediately  yields  the  Inequality 

W  *(x,  y,  r)  <_  $(*,  y,  v). 

Now  by  definition,  hypothesis,  and  the  facts  that  f’  -  ?'(b,  x)B  ^  0, 
ff  -  v  (b,  x)B]  y(b,  x)  m  o  for  all  x,  and  b  -  Ax  -  By(b,  x)  •  o. 


* 


we  GQQ  that 
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y,  Ir)  *»  {o  -  Ett  (b,  X)A  ]x  +  Ejr*(bs  x)b 

<  fo  -  E7  (b,  x)A]x  +  E?‘(b,  x)b  +  E[r*  -  r'fb,  £)B}y(b,x) 

"  0  x  +  Ef  y(b»  x)  +  Et  (b,  x)[b  -  Ax  -  By(b,  x)J 

-  o‘x  +  Ef  y(b,  x)  +  E7’(b,  x)tb  -  Ax  -  I &(b,  x)J 

-  *(x,  y,  f). 


Hence,  by  Theorem  3,  x  is  optimal. 

The  foregoing  result  indicates  that  if  x  e  K  minimi*#*  the 
linear  form  (e  -  Eir  (b,  x)A)x,  then  x  is  optimal.  It  would  be 
worthwhile  to  know  whether  the  converse  of  Theorem  4  la  true. 

We  have  established  this  converse  if  EC(b,  x)  is  differentiable 
and  x  exists  and  is  an  interior  point  of  K{  see  Theorem  2.  we 
shall  later  consider  the  finite  case.  A  kind  of  converse  of 
Theorem  4  la  the  following. 

Theorem  5.  Let  x  and  y(b,  x)  be  optimal  for  the  two-etage 
problem  for  given  b,  and  let  y(b,  x)  and  ?(b,  x)  be  optimal  for 
(4)  and  ita  dual  for  given  x.  Then 


(26) 


E((c  ,  f')  -7'(b,  x)(A,  B))  fx,  y(b,  x)) 
^Ef(o',  f ')  -^(b,  x)(A,  B))  (x,  y(b#  x)). 


Proof.  It  is  seen,  from  the  definition  of  *  and  the  fact 
that  b  —  Ax  —  Ey(b,  x)  -  0,  that 

(2?)  <*>(x,  y(b,  x),  r(b,  x))  «  <£(x,  y(b„  x),  v(E’,  x)). 

Now  the  right-hand  member  of  (27)  is  the  right-hand  member  of 
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(26),  plus  Eir  (b,  x)b;  and  the  left-hand  member  of  (27)  Is 

y,  tt),  which,  by  Theorem  4,  io  greater  than  or  equal  to 

V,  v}»  l.e.,  the  left-hand  member  of  (26)  plus  Ev'(b,  x)b. 

If  there  are  only  a  finite  number  of  possible  b's, 

bl •  •••»  bj|/  with  associated  probabilities  p,,  . p  *  where 
N  N 

1£1f>l  “  then  two-a tage  program  can  be  written  as  follows: 

Plnd  x,  yJ#  y^,  and  min  a  satisfying 

Ax  +  By1  -  b2. 

Ax  +  BjTg  *  bg, 

(28)  ;  *  : 

e 

•  • 

Ax  +  ByN  «  bN, 

*  *  0.  . y„  i  0. 

v'n  +  v'**... 

As  an  application  of  the  duality  theorem  and  the  optimality- 
test  of  the  simplex  method  in  this  special  ease,  we  obtain  the 
following  theorem. 

Theorem  5.  Let  O^x)  be  the  1-th  subvector  (i  •  1,  N) 

In  the  vector  of  prices  associated  with  a  basic  solution 

*  "  x»  ^i  “  ^i*  L  «•  1,  N,  for  (28),  Then  5c,  (y^),  Is 

optimal  if 

1  N  ,  ,  N  , 

C  -  S  Mx)A  2  0,  fc  -  z  e  (x) A]  x  =  0, 

(29)  _  1-1 t  i-1  1 

plf  ~  ei(x)B  Z  0,  Cptf'  -  ^(x)Bj  y4  -  0,  1  »  1,  N. 
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fo,r.fc.heg>  i£  x,  }  is  optimal t  then  there  exist  prl 
satisfying  (29),, 


t  prices  «  (3c) 


ean  ®®slly  prove  Theorem  4  in  the  finite 


4  .  Let  x  -  x  and  su^^ose  that  there  exist  optimal 
*)  l££  program  in  (4)  such  that 

e  -  Ev  (D#  x)A  £  0,  (o'  -  Ev’(b,  x)A )  x  -  0. 

Then  x  is  optimal. 


case. 


Proof.  Take 


(Jo) 


Then 


(31)  Ei  <b'  x)  -  ^  P^V  x)  -  S  0,(x). 

1-1  *  i»i  1 

Aleo,  elnee  r’(b1(  x)  is  optimal  for  the  dual  0f  (»),  it  eatlsfleo 
(J2)  f‘  x)B>  0.  [f'  S)B)  y(tl#  J)  .  0. 


B±(x)  -  P^b^,  x). 


Hence  for  ^  -  y(bi#  x),  the  functions  ^(x)  so  defined  satisfy 
(29);  therefore,  by  Theorem  5,  x  is  optimal. 

The  eonverae  of  this  theorem  la  also  easy  to  prove  m  the 
finite  case. 

Theorem  6.  Le t  x  be  optimal.  Then  there  exist  optimal 
—  ^b'  ill®  program  in  (4)  such  that 
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c  -Ett  (b,  x)A  ^  0,  te‘  -  Ev'(b,  x)a)  x  -  0. 

Proof.  Let  tr^,  x)  «*  ^(xj/p^,  where  the  functions  ^(x) 
satisfy  (29).  Then  [f'  -  tr*  (b±,  x)b]  y*  «=  0,  so  that  yA  -  y(bx,  *) , 
and  irfb^,  x)  Is  a  set  of  optimal  prices  for  (4). 


It  Is  Interesting  to  contrast  this  necessary  condition  for 
the  finite  case  with  that  of  Theorem  2.  In  this  case,  not  only 

I  _!  _ 

Is  c  -  Ett  (b,  x)A  £  0,  but  further  If  the  1-th  coordinate  of 


x  Is  positive  then  the  i— th  coordinate  of  c*  -  Eif^b,  x)A  Is 
zero.  In  the  finite  case,  of  course,  EC(b,  x)  doea  not  eatiofy 
the  conditions  of  Theorem  2  because  here  x  la  an  extreme  point 
of  the  convex  region  of  Interest  and  EC(b,  x)  Is  not  differentiable 
In  the  neighborhood  of  the  extreme  points  of  this  convex  region. 

A  simple  example  of  a  two-stage  problem  satisfying  the 
conditions  of  Theorem  2  Is  the  problem  solved  In  [j?J.  There  x' 
was  a  two-dimensional  nonnegative  vector  (x^,  x^)  with  fixed 
constraint  +  *2  *  100  ao  that  K  was  a  line  segment  In  the 
first  quadrant,  and  b  was  distributed  uniformly  between  70  and 
80;  EC(b,  x)  waa  differentiable  at  the  optimum  x  •  (75,  25),  a 
relative  Interior  point  of  K,  and  although 


(55) 


v(b,  x) 


(0,  Vp ) ,  b  x^ , 

(2,  7Tg  )  ,  b  >  x1# 


was  optimal  for  the  dual  of  (4),  where  Vp  could  take  on  any 
value,  the  particular  £(b,  x)  for  which  Theorem  2  held  had 

7?2  **  0- 
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h  _  COMPUTATIONAL  PROCEDURES 

Since  the  determination  of  an  optimal  y,  given  x  and  b, 
la  a  straightforward  application  of  linear  programing  technique 
to  the  program  defined  In  (4),  our  objective  la  to  find  method, 
of  determining  an  optimal  *  other  than  by  solving  tha  larg. 
program  (28).  *0  win  shortly  be  seen,  an  application  of  the 

decomposition  principle  ft )  to  the  dual  of  (26)  win  reduce  the 
site  of  the  program  greatly  and  will  directly  obtain  for  us  only 
the  optimal  x  and  not  the  optimal  set  of  y. 

By  virtue  of  'Theorems  4  and  6,  tha  problem  dual  to  (28) 

can  be  expressed  as 

p/rj  +  P2Ah2  +  ...  +  p/s,,  <  c. 

B  *1  <  f, 

Blr2  < 

W) 

f  ® '  ^yjr  < 

5>ibi1ri  +  *>2Va  +  •  •  •  +  pnVh  *  "»*• 

We  now  note  that  the  dual  problem  is  In  tha  standard  form 
for  application  of  tha  decomposition  algorithm  (4}  to  solve  the 
program.  To  use  the  algorithm,  it  ia  convenient  to  call  the  last 
N  aete  of  Inequalities  in  &)  a  single  subprogram  and  the  first 

set  of  inequalities  the  master  program.  This  will  reduce  the 

program  from  one  with  nx  +  No,  to  one  with  rij  +  1  constraints. 
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For  notational  convenience  In  describing  the  algorithm, 
let  B  be  a  Nm  x  Nng  block  diagonal  matrix  of  the  form 

■fe  0 

* 

•  % 

% 

0  B 

?  be  a  No, -dimensional  vector  of  the  form  f*  •  {f*  ...  f ' 

*  m  [fi  •••  ^N1'  1A‘  •••  an(i  -  ^lb'i  •••  PNV* 

Then  (j4)  can  be  rewritten  as 


A  v  c, 

(35)  b’tt  <  ?, 

n>  Ia> 

b  v  -  max. 

Let  S»(ir}Bir<f)  and  let  W  »  . ..,  tt^)  be  the  aet  of 

extreme  pointa  of  the  convex  set  S.  We  assume  here  that  3  is 
a  bounded  set;  the  slight  modification  in  the  algorithm  for 
unbounded  3  is  given  in  [4).  Also  let  P,  »  At,  and 

=  b  ir^  for  J  •  1,  ...»  k.  The  extremal  problem  corresponding 
to  (55)  is  to  find  numbers  A^,  A^  such  that 


(36) 


A^  +  Ag  +  . •  •  +  Aj^  =  1 , 

Aj  ^  0,  Ag  ^  0  •  •  •  *  ^  0, 

rl^l  +  r2^2  +  •••  +  rk\  =  max‘ 


Then,  aa  ia  ahown  in  14],  v 


2  A, if,  eolvea  (55). 
J=1  J  J 


Now  this  program  ha3  even  more  variables  than  (35),  namely 
kNm;  moreover,  k  can  be  very  large  and  hence  it  is  not  practical 
to  determine  W  explicitly.  Equation  {36)  only  has  n1  +  1 
constraints,  however,  and  one  need  never  carry  more  than  n^  +  1 
variables  in  solving  this  equation  when  using  the  decomposition 
algorithm. 

The  algorithm  is  initiated  once  one  has  a  feasible  basis 
for  (36),  i.e«,  n2  +  1  vectors  ttj  (to  determine  the  necessary 
nl  1  vectors  Pj)and  ^  +  1  values  Xj  that  are  positive  and 
satisfy  the  constraints  of  (36).  (This  may  be  obtained  using 
Phase  One  of  the  simplex  method,  for  which  see  [4  ] . )  The  prices 
for  this  basis  are  then  determined  and  are  used  to  generate 
those  extreme  points  of  s  that  appear  promising  and  to  suppress 
the  others.  This  is  done  with  each  new  basis  formed  during  the 
process.  In  this  case  x  will  be  the  price  vector  for  the  first 

constraints  and  we  shall  call  z  the  price  for  the  last  constraint. 
When  (36)  is  solved,  the  resulting  price  x  is  optimal  for  the 
original  program  (28). 


As  the  algorithm  is  iterative,  generating  new  prices  with 
each  Iteration,  we  shall  append  the  superscript  t  to  x  and  z 
to  denote  the  appropriate  iteration.  Given  the  initial  feasible 
basis,  we  obtain  concomitantly  x°  and  s°.  To  test  optimality 
of  x°  and,  if  not  optimal,  to  generate  a  new  basis,  one  must 
first  find  the  tt  =  ip  that  maximizes  tt  (b  —  Ax®)  —  z®  subject 
to  D  v  <  f.  If  f  (b  —  Ax®)  —  z°  >  0,  the  algorithm  is  termi¬ 
nated,  and  xC  solves  (28).  if  not,  a  new  column  is  added  to 
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the  rtj  +  1  columns  of  the  initial  basis,  namely 


and  its  associated  cost  b  m°  is  added  to  the  objective  funotion. 
By  means  of  the  simplex  method,  a  new  basis  and  new  prices 
x1,  zx  are  determined,  the  v  -  t1  that  maximises  ir'fb  -  ax1)  -  t1 
subject  to  B  tt  £  f  is  determined,  and  once  again  we  test  tt1  for 
optimality.  The  process  terminates  when  for  Borne  iteration  t 
and  prices  xt,  zt,  we  have 

(37)  £.ISaJ  v'(b  -  Axfc)  4  zt  2  0. 

Notice  that  all  one  needs  to  carry  along  In  the  compu¬ 
tation  ara  the  columns  of  the  current  basis,  ♦  1  In  all. 

At  iteration  t,  if  (37)  is  not  satisfied,  the  column 


Is  added  to  the  basis  and  the  simplex  method  determines  the 
appropriate  column  to  remove  from  the  'basis  and  hence  from 
consideration  In  subsequent  calculation. 

Since 

(38)  b  7 r  »  Pl7r  (b1#  x)bjL  =  Eir'(b,  x)b 

and 
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.  .  f\j,  %  ,  ■*'*  |  I 

(29)  TT  Ax  »  ^2  p±v  ( b± ,  x)ax  «  Ett.  (b,  x)Ax, 

we  see  that  the  test  for  optimality  can  be  rewritten  as 


(40)  max  Ev  (b,  xfc)b  -  Eir'(b,  xt)Axt  -  zt  >  o. 

~  « "V.  4- 

B  7T<? 

It  can  also  be  shown  that,  at  the  optimal  rr,  we  have 


<*1> 


t  ,  M  . 

z  »  min  s  f  7., 

1=1 


where  £  o  satisfies  By1  ^  -  Ax‘ 
The  inequality 


<**) 


min 

^>0 

By^b^-AX 


■  ,mx  *  „  Pi' *  (V  *)(b  ^  Ax) 
B  Trfb^,  x)<f  A  1 


holds  for  any  feasible  y±  and  tr±  of  the  subprogram.  Summing 
(42)  for  i  ■  1»  • • • >  N  yields  (4o)  with  the  inequality  reversed. 
Hence  the  test  for  optimality  can  be  interpreted  as  checking 
whether  equality  holds  in  (4o)  or,  when  we  substitute  the  value 
of  zt  given  in  (4l),  whether  x*),  1  -  1,  N)  satisfies 

(*3)  E  min  f’y  =.  Eir’(b,  xt)(b  ~  Axfc), 

y 

i.e.,  is  optimal  for  the  dual  of  (4),  and  whether 
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In  other  words,  the  test  for  optimality  of  the  decomposition 
algorithm  is  an  implementation  of  the  sufficient  condition  for 
optimality  given  in  Theorem  4'. 

As  EC(b,  x)  is  a  convex  function  of  x  defined  over  a  oon- 
vex  set,  the  problem  of  minimizing  EC(b,  x)  is  a  problem  in 
convex  programming.  The  following  procedure  for  solving  this 
problem  is  an  application  of  Lemma  2  and  a  technique  due  to 
Kelley  [5);  see  also  (7]. 

We  assume  here  that  aside  from  the  condition  x  ^  0,  there 
are  enough  fixed  and  induced  constraints  on  x  bo  that  x  lies  in 
a  bounded  convex  polyhedron  defined  by,  say,  ffx  •  F.  The  pro¬ 
blem  is  then  the  following? 

Ax  «  F, 

EC(b,  x )  <  z, 

(45) 

x  ^  O, 
z  •=•  min. 

To  initiate  the  algorithm,  let  x°  be  feasible.  Consider 
the  linear  program 


i 

0  X 

(46) 


Ax  a  F, 

_  I 

+  Em  (b  -  Ax)  <  z, 

X  £  0, 

z  =  mi  n . 


Let  x 


1 


solve  this 


program. 


and  now  consider  the 


program 
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Ax  «  F, 

*  _ t  n 

c  x  -f  Ett  (t>,  xu)(b  -  Ax)  <  z, 

(^7)  c  x  +  Ett  (b,  x1)(b  -  Ax)  <  z, 

*  >  0, 

z  =  min. 

2 

Let  x  solve  this  program. 

One  sees  that  on  the  k— th  Iteration  of  this  procedure  one 
solves  thfe  program 


Ax  =  F, 

Ax)  <  z,  i  -  0,  . k  -  1, 

*  ±  0> 
z  =  min. 

Kelley  has  shown  that  llm  EC(b,  x-lc)  is  the  minimum  of  EC(b,  x), 

k-**> 

trough  lim  x  does  not  necessarily  solve  the  convex  program. 
k-e> 

An  alternative  procedure  [5]  rewrites  (4p)  as 


(48) 


»  4 

c  x  ♦  Ett  (b,  x  )(b  - 


Ax  «*  F, 

x  >  0, 

(49) 

'  w  +  EC(b,  x)  =  0, 

w  »  max, 

and  uses  the  decomposition  principle  with  Ax  «  F,  x  ^  0  as  the 
master  program  and  w  +  EC(b,  x)  =  0  as  the  single  subprogram. 
The  extremal  problem  equivalent  to  the  master  program  is 
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Xj  +  •  •  •  4-  Xk  =*  1 , 

(5°)  (Ax1)X1  +  ...  +  (Axk)Xk  .  F, 

EC(b,  x  )XX  +  ...  +  EC(b,  xk)Xk  =  min, 

where  the  values  x1,  xk  need  not  be  feasible,  provided 

some  convex  combination  of  them  la.  once  this  program  Is 

solved  and  prices  p^,  p  are  generated,  one  must  solve  the  sub¬ 
program 

w  +  EC(b,  x)  =.  o, 

(51)  k*_  k 

x  +  p  Ax  +  p*  m  max, 

or,  equivalently,  one  must  find  x  -  xk>1  such  that 

V*)  -  EC(bt  x)  -  pk’lx  -  pk 
is  a  minimum.  If  for  all  x  we  have 
(53>  EC(b,  x)  £  pk,Ax  +  pk, 

that  EC(b,  xk+1)  is  minimal.  If  not,  another  column 


is  added  to  (50),  EC(b,  xk+1 )  Xk+1  is  added  to  the  cost  form 
in  (50),  and  the  algorithm  is  iterated.  In  [3]  it  is  shown  that 
lim  EC(b,  xk)  is  the  minimum  of  EC(b,  x). 

\r  wvi  '  7  * 
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1 ■  DISCUSSION 

It  Is  wen  known  (see,  e.g.,  (2))  that  replacing  the  random 
b  by  its  expected,  value  is  of  little  help  in  solving  the  etochaetlo 
linear  program,  We  have  seen  from  the  above  discussion,  however, 
that  the  expected  values  of  the  prices,  with  x  fixed  for  the 
program  given  in  (4),  play  a  critical  role  in  solving  the  stcchaatlc 
linear  program.  In  faot,  roughly  speaking,  the  veotor 

.  *  —I .  _  I 

(0  -  Em  {b,  x)A)  acts  as  the  gradient  of  the  funotion  EC(b,  x). 

An  interesting  area  for  future  consideration  is  the  effect  of 
bo-mpllng  from  the  distribution  of  b,  estimating  Em(b,  x)  and 
Em  (b,  x)b  for  each  value  of  x  generated  by  the  iterative  pro¬ 
cedures  given  above,  and  using  these  estimates  as  Em(b,  x)  and 
Em  (b,  x)b  in  those  procedures. 
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1955.  Published  in  Linear  Inequalities  and  Related 
Systems,  Annals  of  Mathematics  Study Tio.  38,  edited 
by  H.  W.  Kuhn  and  A.  W.  Tucker,  Princeton  University 
Press,  1956,  pp.  207-214.  (ASTIA  No.  AD  88670) 
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29,  1955*  Published  in  Canadian  Journal  of  Mathematics. 
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Part  38:  Note  on  B.  Klein's  "Direct  Use  of  Extremal 
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Studies  in  Linear  and  Non-linear  Programming,  by 
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